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Interesting work is being done in programing computers to 
solve problems which require a high degree of intelligence in 
humans. However, certain elementary verbal reasoning processes 
so simple that they can be carried out by any non-feeble -minded 
human have yet to be simulated by machine programs. 

This paper will discuss programs to osnipulate in a suita.- 
blo formal language (csost likely a part of the predicate cal- 
culus) common Instrumental statements, The basic program will 
draw immediate conclusions from a list of premises*. Those con- 
clusions will be either declarative or imperative sentences. 
When an imperative sentence is deduced the program takes a cor- 
responding action* those actions may include printing sen- 
tences, moving sentences on list3, and reinitiating the basic 
deduction process on these lists* 

Facilities will be provided for* coi^unication with humans 
in the system via manual intervention a::d display devices con- 
^ nected to the computer 



The "advice taker" is a proposed program for solving 
problems by manipulating sentences in formal language. The 
main difference between it end other programs or proposed 
programs for manipulating formal languages (the "Lcgis Theory 
Machine" of Hewell, Simon and Shaw and the Geometry Ir-ograia 
of Gelernter) is that in the previous programs the formal sys- 
tem was the subject matter but the heuristics were all em- 
bodied in the program. In this program the procedures will 
be described as much as possible in the language itself and, 
in particular, the heuristics are all so described. 
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This paper was presented at a Symposium on The Mechanisation 
of Thought Processes, which was held at the National Physical 
Laboratory, Toddington, Middlesex, England from 2feth-27th 
November i95'3. The papers and the discussions were published 
by H.M.S.O. in the Proceedings of the Symposium. This paper 
should not be reproduced i-jithout the permission of the author 
and of the Secretary, National Physical Laboratory. • 




The main advantages wo ex-sect the "advice tahsr" to hsve 
is that its behavior Kill be improvable merely by making state- 
ments to it, tellin-g it about ito symbolic environment and 
??S;, 13 wantea from ifc » ^o wake those statements will reoulra 
little if any knowledge of the program or the previous know- 
ledge of the 'advice taker". One will be able to assume that 
I^ * J^Y* C ? t ! a - 2 ? ?iH have available to it a fairly wide class 

told and its 
much in 
having com- 
mon oense. be shall therefore say that: A program has common 
sense if it automatically deduces for itself a sufficiently 
wide class of immediate consequences of anything it is told and 
whac it already knows. 

The design of this system will be a joint project with 
Marvin Kinsley, but Hinsky is not to be held responsible for the 
views expressed here. 

Before describing the "advice ta'.ror" in any detail. I would 
like to describe mors fully our motivation for proceeding in 
this direction,, Our ultimate objective is to mbce orogrmms that 
learn from their experience as effectively as humans do. It may 
not be realised how far we are -resent ly from this ohlecttve. 
It is not hard to make machines lesrn from ezrsorier-oe to malce 
v stole changes in their Lshavior of a kind which h----o been an- 
ticipated by the prog^.... ;i :3r. Tor enamels, Samuel has included 
A n his checker program facilities for ianroviDg the weights the 
macnine assigns to various factors in evaluating positions. Ee 
has also included a nchems whereby the machine remembers games 
it has played previously and deviates from its irrevious oiay 
waen it finds a position which it -previously lost. Sunrjose, 
however, that we wanted an improvement in behavior correspond- 
ing, say, to the discovery by the machine of the nrineinle of 
the opposition in checkers, jfo present or presently proposed 
sememes are capable of discovering phenomena as abstract* as this. 

If one wants a machine to be able to discover an abstraction, 
it seems most likely that the machine must be able to represent 
this abstraction in some relatively simple way. 

Tliere is one known way of making a machine cacabie of 
learning arbitrary behavior; thus to anticipate every kind of 
penavior. Tnis is to cake it possible for the machine to stimu- 
late arbitrary behaviors and try them out. -These behaviors may 
be represented either by nerve nets (ref. 2), by Turing ma- 
chines (ref. 3), or by calculator programs (ref. *!•). The -diffi- 
culty is two-fold. First, in any of these representations the" 
aensicy of interesting behaviors is incredibly low. Second, 
and even more important, small interesting changes in behavior 
< expressed at a high level of abstraction do not have stole 
V representations. It is as though the human genetic structure 
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(V_" were represented by a eat of blue-prints. • Then a mutation would 
usually result in a wept op a failure of ' parts to meet, op even 
an ungran^atical blue -print which could not bo translated Into 
an animal at all. It is vary difficult to see how the genetic 
representation scheme manages to be gsneral enough to represent 
the great variety of animals observed and yet be such that go 
many interesting changes in the organism are represented by 
small genetic chaises. £he problem of how such a rc-Dresentation 
controls the development of a fertilised egg into a mature ani- 
mal io even more difficult . 

In our opinion, a system which is to evolve Intelligence of 
human order should have at least the following features: 

1« All behaviors must be reprosontablo in the system. 
Therefore, the system should either be able to construct 
arbitrary automata or to program in soma general purpose 
programming language. 

2. Interesting changes in behavior must be expressible in 
a simple way. 

3» All aspects of behavior except the most routine must- 
be improvable. In particular, the improving mechanism 
should be improvable. 

h. The machine must have or evolve concepts of partial 
^ success because on difficult problems decisive successes 
or failures come too infrequently. 

5- The system must be able to create subroutines which 
can be Included in procodur-es as units. tec learning of 
subroutines is complicated by the fact that tee effect of 
a subroutine is not usually good or bad in iteelf . There- 
fore, the mschanism that selects subroutines should have 
concepts of an interesting or powerful subroutine whose 
application may be geed under suitable condition::. 

Of the 5 points mentioned above, our worh concentrates 
mainly on the second. \'o base ourselves on the idea that: In 
order for a program to be capable of. learning some thine it must 
first be capable of being told It. In fact, in the early ver- 
sions we shall concentrate entirely on this point ena attemot 
to achieve a system which can be told to make a specific ira- 
pro*/cEsnt in its behavior with no more knowledge of Its internal 
structure or previous knowledge than is required in order to in- 
struct a human. Once this Is achieved, we "may be able to tell 
the "advice tabor" how to learn from experience. 

The main distinction between the way one programs a computer 
and modifies the program and the way one instructs a human or 
will instruct the "advice taher" is this: A machine is instructed 
mainly in the form of a sequence of imperative sentences; while a 
t human Is Instructed mainly in declarative sentences describing 
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_ the .situation in which action in required together with a few 
imperatives that say what is wanted. t?e shall list the ad- 
vantages of the two inethcds of instruction. 

Advantag es of Im perative Sentences 

1. A procedure described in imperatives is already laid out and 
is carried out faster. 

2. One starts Kith a machine in a basic state and does not assume 
previous knowledge on the part o.? the siachine. 

Adv antag e 3 of Declarative Sentences 

1. Advantage can be taken of previous knowledge. 

2. Esclaratlve sentences have logical consequences and it can 
be arranged that the machine will have available sufficiently 
simple logical consequences of vaiat it is told and what it pre- 
viously knew. 

3. The cleaning of declaratives is r,uoh less dependent on their 
order than 13 the case Kith imperatives. This makes it easier 
to have after-thoughts . 

I 4-. The effect of a declarative is lens dependent on the pre- 
v " vious state of the systera so tnst lest knowledge of this state 
is required on the part of the instructor. 

The only way we know of expressing abstractions (such as 
the previous oxarcple of opposition in checkers) is in language. 
That is why we have decided to program a system which reasons 
verbally. 



THE COUSTRUCTIOH OF THE ADvTLCE TAKER 

The "advice taker" 'systsa lias the following cain features: 

1. There is a irothod of representing expressions in the compu- 
ter. These egressions are Sefined recursively as follows: A 
class of entities called tsna3 is. defined and a terra is an ex- 
pression. A sequence of expressions is an expression. These r 
expressions are represented is fcla Eachine by list structures (ref.l), 

2. Certain of these egressions may be regarded as declarative 
sentences in a certain logical system which will be analogous to 




a single rule of inference which will combine substitution for 
/"""■ variables with inodus ponens. The purpose of the combination is 
L to avoid choking the machine with special cases of general pro- 
positions already deduced. 



-5- 

3« There is an irradiate deduction routine which when Qlvon a 
sat of proniocs Kill deduce a est: or iimediate conclusions. 
Inat.lr.21y. the immediate deduction routine- Kill singly write 
down nil one-step consequences of the precises. Later, thin tray 
be elaborated so that the routine will" produce soks other con- 
elusions which snap be of interest. However, thi3 routine will 
not use semantic heuristics; i.e. heuristics which depend on the. 
subject tnattcr under discuo&ion. 

The intelligence, if any, of the advice taber will not be 
en-bodied in the irradiate deduction routine. This intolli-. 
gence will be embodied in the procedures which choose the lists 
of premises to which the it-radiate deduction routine is to be 
applied. Of course, the program should never attest to apply 
the ita^dlate deduction routina siiaultarscroly to the list' of 
everything it knows. This would c?al:e the deduction routine take 
too ions- 

4. Not all expressions are interpreted by the system as de- 
clarative sentences. Some are the na^as of entities of various 
kinds. Certain formulas represent objects • For our purposes , 
an entity is an object if we have sorethiDS to say 'about it 
ether than the things which rnay be deduacd frorn the form of its 
nac3» *or example, to ir.es t people, tho nurber 3012 is not an 
object; they have nothing to cry about it except what can be de- 
duced from its structure. On the other Land, to nest Americans 
the nuwbsr i77o i3 an object 1: a cause they have filed scrowhoro 
the fact that it represents the pear when the Av.orloan Revolu- 
tion started. 2n the "advice taker 11 each object has a proper- 
ty list in which are lifted the specific thirds we have to" say 
about it. Sc*:3 thirp;s which can be deduced frox the nans of 
the object tray be included in tlx: property list aayhew if the 
deduction was actually carried out" and was difficult enough so 
that the system does not want to carry it out again. 

5. Entities other than declarative sentences which can be repre- 
sented by formulas in the system are individuals, f unctions, and 
proGrams . 

6. The program is intended to operate syolically as follows. 
Ths imxodiate deduction routine is applied to a list of premises 
and a list of individuals. Sor.2 of the conclusions hare the 
forra of iterative sentences. These are obeyed, Included in 
the set of imperatives which nay be obeyed is the routine which 
deduces and obeys. 

We shall illustrate the way the "advice taker" is supposed 
to act by weans of an example. Ascuxo that I ans seated at"ny 
desk and I wish to go to the airport. Ky car is at cy horr.e also. 
Tho solution of the problesi is to wail: to the car and drive the 
car to the airport. First, we shall give a formal statement of 
the premises the "advice tafer" uses to eras? the conclusions. 
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^J Thsn rce shall discuss the heuristics which cause the "advice 

taker " to assen&le these premises from the totality of facts it 
has available, £ho premises cosie in groups, and rre shall ex- 
plain the interpretation of each group, 

1. First, ue have a predicate "at". "at(x,y) n i3 a fonnalisa- 
tion of "x is at y*V Under this heading t-e have the premises 

1, at (I, desk) 

2. at (desk, noise) 
3* at (car, hose) 

4 S at (home, county) 

5, at (airport, county) 

We shall need the fact that the relation "at" is transitive 
which Eight he written directly as 

6. at (x,y), at(y,z) -* a£(x,z) 

or alternatively vie E&ght instead use the Eore abstract premises 

6 s . transitive (at) 
and 

7». transitive (u) ~* " (u(x,y), u(ya,s) ■-* u(x,s) ) 
from which 6. can he deduced, 

2. There are tiro s?ules concei 7 nius the feasibility of walking 
and driving. . 

8, ualhable(x), at(y,x), at(s,x), at (I,y ) ^ can (go (y,s, talking) ) 

9, drivable(x), at(y,x), at(car,y) at(2,car) ~» can(go(y,2, driving) ) 

3!here are also trio specific facts 

10. ualtehle (home). 

11, drivahle (county) 

3, Eext tfa have a rule concerned with the properties of going, 

12. did(go(x,y,s) ) -* at(I,y) 

4, Thz probles itself is posed by the premise: 

13, uant (at (I, airport) ) 
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(l_* 5° The a^ove are all tho provisos concerned r .Ith the particular 
problou. The last group of premises are ec^: a to almost all 
problem of this sort. They are: 

i*!> (3: -* can(y) ), (did(y) *~> s) -> canaciiilt{x,y,2;) 

©13 predicate n canachr.lt(::*y,z) w means that in a situation to 

. isbich 2: applies ^ tho action y con be performed and brings about 
a situation to nhich 2 applies. A sort of transitivity Is de- 
scribed by 

±5- canachultfc/^z), canaoImlt{s.u ? v) -* canachi*lt(s,pros(y / u),v)# 

Eere pro^(u*v) is the program of first carrying out u and than v# 
(S01120 Iciv/I of identification of a circle action u uith tho 0113 
stop pro&rars prcs(u) is obviously required* but tho do tails of 
how this uill fit into tho for&sliaia have not yet been worked out), 

Tho fln^l premise Is tho one mich canoes action to be taken. 

16 c s^canachultC^progCy^sJ^vj), uant(u) -* do(y) . 

21i3 arsunient tho ^advice tailor" cust produce In order to 
solve tho problem deduces the foIlo?;in:; propositions In core or 
less tho follo^ins order: 

le at(X^<2eGlc) ^ cai2CGo(da£l:^car.t:alt:Ins) ) 

2. at(l # car) ^ ccinCGoCho^a^airport^drivIns) ) ' .,*' 

3* fiid(Eo(fio^:..oai%rai:cins) ) -* at (I, car) 

'*. dia(co(ho^/^>£irpoi*t,ctriviK3) ) ~- ! * at ( I, airport) 

5« canacirolt{at(l,(2e3l:), co (deal:* ear. imlkin^)* at (I, car) ) 

6. canachi-.it (at (I, car), go (ho^e , airport, drivins), at (I , airport) ) 

J. cana?hult(at(l,dcs!::), pra^ra^CsoCd^Dl^^car^tJailcins), go(hoc:e, 
airport, driving) ) 8 ~* at {l t airport) ) 

8. do(so(c;os!: f car f v;alkir fc s) ) 
Tho deduction of the last proposition initiates action* 



Tho above proposed reasoning raises tv:o major questions of 
hour-Is tic. Tho first Is that of hoi? tho 16 promises are collect- 
ed^ and tho second is that of ho:-; the deduction proceeds once 
thoy are found, t-fe cannot give eotnpiefce anst-rers to either ques- 
tion In the present paper; thoy are obviously not completely 
separate since seise of the deductions raisht be made before 
sor- pf the premises are collected* Let us first consider the 
question of tjhere the 16 premises come from. 
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First of all, wo assert that cxcetDt for the 13th promise 
(want (at (X. airport) ) which seta tho goal) and the 1st premise 
(at (X, desk) which we shall got from a routine which answers the 
question "whore am X"), all the premises can reasonably be ex- 
pected to be specifically present in the memory of a machine 
which has competence of human order in finding Its way around. 
That is, none of them are so specific to the problem at hand 
that assuming their presence in memory constitutes an anticipa- 
tion of this particular problem or of a class of problems nar- 
rower than those which. any human can expect to have previously 
solved. Mq must impose this requirement if we are to be able to 
say that the "advice taker !S exhibits common sense. 

On the other hand, while we may reasonably assume that the 
premises are in memory, we still have to describe how they are 
assembled into a list by themselves to which the deduction 
routine may be applied. Tentatively, we expect the "advice 
taker" to proceed as follows: initially, the sentence "want£at(!C, 
airport) )* is on a certain list L, called the main list, all 
by itself. The program begins with an observation routine which 
looks at the main list and puts certain statements .about the con- 
tents of this list on a list called "observations of the main 
list". We shall not specify at present what all the possible 
outputs of this observation routine are but merely say that in 
this case it will observe that "the only statement on L has 
the form *want(u(x) )'** (!?£ write this cut in English because 
we have not yet settler! on a formalism for representing state- 
ments of this kind. ) The "deduce and obey" routir-3 is then ap- 
plied to the combination of the "observations of 'the main list" 
list, and a list called the "standing ordsr3 list". Ihis list 
is rather small and is never changed, or at least '3s uuly changed 
in major changes of the advice taker \ The contents of the "stand- 
ing orders" X:U>t has not beon worked out, but what must be de- 
duced is the extraction of certain statements from property lists. 
Namely, .the program first looks at "want (at (I, air p or- 1 5 ;" and' at- 
tempts to copy the statemants on its property list. Let U3 as- 
sume that it fails in this attempt because "want (at (X, airport) )" 
does not have the status of an object and hence has no property 
list. {One might expect that if the problem of going to the 
airport had arisen before, "want (at ( I ..airport) ) w would be air 
Qbject, but this might depend on whether there were routines 
for generalising previous experience that would allow something 
of general use to be filed under that heading.) ITsst in order 
of increasing generality the machine would see if anything" were 
filed under s want(at(X,x) )" which would deal with the general 
problem of getting somewhere. One would expect that premises 6> , 
(or 6* and 7»), 8, 9, 12, would be so filed. There would also " 
be the formula 

want(at(X,x) ) -» do (observe (where am X) ■) 
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v • which would cive us premise 1. Thors would also be a reference 
to the nsxt hisbar level of abstraction in the goal statement 
wniqn would cause a loolc at the rroBerty list of "wantfc;)". 
Tiii3 would give us Ik, ±5, and 16. * 

We shall not try to follow the solution further exceot to 
remark that •uanfc{afc(I,x) )" there would be a rule that starts 
with the premise : 'at{l,y)" and "v>ant(l,x) n and has as conclusion 
a search for the property list of n so(y,x,e) n . This would pre- 
suuiaoly fall, and then there could have to be heuristics that 
would initiate a search for a y such that M at(X,y)" and "at( 
air-port, y) . This would be done by looking on the ero»srty 
lists of the origin and ths destination and working* uo"^ Tiisn 
promise 9 would be found which has as one of its orarjises 
at (I, car). A repetition of the above would find preirfse 8, 
which would con-plots the cot of promises since the other "at" 
premises would have been found as by-products of previous searches 

VJe hope that the presence of the heuristic rules mentioned 
on the- property lists where we have put thsra will seem plausible 
to the reader. It should be rotieed that on the higher" level of 
abstraction many of the statements are of the stimulus -response 
form. One night conjecture tha : ; division in rcan between con- 
scious and unconscious thought occurs at the boundary between 
stimulus -response heuristics which do not have to be" reasoned 
i about but only obeyed , and the others which have to serve as 
premises in deductions. 

. h"e hope to formalize the heuristics in another oa^er before 
we start programing the system. 
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